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Abstract 

Based on a Fokker-Planck description of external Ornstein-Uhlenbeck noise 
and cross-correlated noise processes driving a dynamical system we examine 
the interplay of the properties of noise processes and the dissipative charac- 
teristic of the dynamical system in the steady state entropy production and 

flux. Our analysis is illustrated with appropriate examples. 
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I. INTRODUCTION 



A dynamical system in contact with a reservoir has been a subject of wide attention 
in dissipative dynamics and irreversible thermodynamics. The focal theme lies on the pos- 
sible link between the rate of phase space volume contraction and the thermodynamically 
inspired quantities like entropy production, entropy flux, Onsager coefficients etc. [TTJ . 
While on the other hand it has been argued that the entropy production is related to the 
intrinsic properties of phase space structure of the dynamical systems through the Lyapunov 
exponents [pHTTf , the traditional wisdom asserts that entropy production in a class of ther- 
mostatted Hamiltonian system is defined |§ as the work per unit time (in the leading order) 
done on the system by an external constraint under nonequilibrium steady state condition. 



Recently based on a Markovian description of a stochastic process Daems and Nicolis [12 



have critically analysed the two aspects from the consideration of an information entropy 
balance equation. 



The object of the present paper is to extend the treatment to colour ]T3|] and cross- 
correlated noise processes [14].[15| and to search for an appropriate signature of an intrinsic 
interplay between the noise properties of these processes and the dissipative characteristics 
of the dynamical system in the steady state entropy production and flux. We specifically 
consider the overall system to be open, i. e. , the noises are of external origin such that 
they do not, in general, satisfy fluctuation-dissipation (F-D) relations. Whenever possible 
we allow ourselves to make a fair comparison with the standard results for closed systems. 

The organisation of the paper is as follows: In Sec. II we consider two types of ex- 
ternal, stationary and Gaussian noise processes namely, the Ornstein-Uhlenbeck and cross- 
correlated noise processes in terms of a Fokker-Planck description and set up an entropy 
balance equation to identify the drift term which reveales that in addition to dissipation 
constant it contains the essential properties of noise processes. Sec. Ill is devoted to explicit 
examples to calculate the entropy production. The paper is concluded in Sec. IV. 
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II. THE NOISE PROCESSES AND ENTROPY PRODUCTION 



A. Fokker-Planck description 

1. External Ornstein- Uhlenbeck noise processes 

The Langevin equations of motion in phase space for an N-degree-of-freedom system 
which is driven by the external colour noise process rji can be written as 

dH 

OPi 

OH 

Pi = —5 liPi i = l---N. (1) 

oqi 

N is the number of degrees of freedom of the system. % is the damping constant for i-th 
degree of freedom. qi,Pi are the corresponding co-ordinate and the momentum, respectively. 
While the presence of 7$ imparts a dissipative character in the dynamics, the stochastic 
forcing rji ensures a canonical distribution at equilibrium when the fluctuation-dissipation 
relation is satisfied. H is Hamiltonian of an initially the conservative system and is given by 

N 2 

ff = E| + nM,t) • (2) 
1=1 z 

The masses of all the degrees of freedom have been set to unity. V({qi},t) is the potential 
of the Hamiltonian system. 

The term rji in Eq. (1) refers to an external, Gaussian colour noise for the i-th degree of 
freedom and follows the two time correlation function 

D° i*-*'i 

fa(t)i*(f)> = —e-~ (3) 

n 

where Tj is the correlation time and D® is the noise strength. The time evolution of rji can 
be conveniently expressed in terms of the white noise process Q(t)-for the i-th component 



m = — + - — C« 

Ti Ti 
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Ut)Ci(t'))=25(t-t') 
(Ci) = • 



(4) 



In case there exists no fluctuation-dissipation relation between 7, and rji the system 



described by the Eq. (1) is sometimes termed as thermodynamically open |16 



Eq.(4) implies that rji can be treated as a phase space variable on the same footing 
as qi, pi. Thus the original 2N dimensional stochastic system (1, 3) now becomes a 3N 
dimensional Markovian process where Eq. (1) and (4) are written in a compact form 



where 



XA 



Xi = Fi(X)+Ci 

qi for i = 1, • • • , N 

Pi ioTt = N + l,---,2N 

T)i forz = 2N + !,-•■, 3N 



(5) 



F = X t+N for i = 1, ■ ■ ■ , N 



dV(X ir --,X. 



N 



OX,-,, 



jiXi + Xi+N ioii = N+l,---,2N 



and 



X \ D° 

Fi = i+V_L^. for z = 2iV + l,-- -,37V 



m)Q(t f )} = fori = l,.-.,2iV 



(d(t)(i(t')) = 25(t-t') fori = 2JV + l, 



3N 



(6) 



The Fokker-Planck equation [T3|] corresponding to Langevin Eq.(5) can be written as 

37V 



(7) 



D° 
1 



where 

P(X, t) is the extended phase space probability distribution function. The extension 
is due to the inclusion of iV noise variables due to the external agency as phase variables. 



We conclude by pointing out that the above formulation contains the thermodynamically 
closed system as a special case where the internal noise strength D 4 ° is related to dissipation 
7i through the relation D® = jikT, where T refers to the equilibrium temperature of the 
reservoir. 



2. Cross- correlated noise processes 

Next we consider a dynamical system driven by both additive and multiplicative noise 
processes r\i and Q, respectively. The Langevin equation for this process, in general, can be 
written as 

X i = L i ({X i },t)+g i (X i )( i + r H i = l,---,N (8) 

Li contains the dissipative term as well as the external applied deterministic force, if any. 
gi(Xi) is the coupling between the system and the multiplicative process. Q and r\i are white, 
Gaussian noise processes with the following correlation between them; 

Ut)Q{t')) = ^D' lJ 5{t-t')5 l] 
(rii(t)Vj(t , )) = 2a ij 5(t-t , )5 ij 

m)vAt')) = m') Vj (t)) = 2X ijs jD' ij a ij 8{t - lf)S i:i (9) 

D'^ and correspond to the strength of multiplicative and additive noises, respectively. 
A represents the cross correlation between them with the limit < A < 1. The cross 
correlation between these noise processes is known to cause symmetry breaking leading to 



non-equilibrium phase transitions |L4| in spatially extended systems and generate interesting 
ratchet motion |15| in systems with symmetric potential under isothermal condition. 
The Fokker-Planck equation corresponding to Langevin Eq.(8) can be written as 

where the drift for the z-th component Fi is 



F i = L i ({X i },t) + ^ 



dXi 



(11) 



v — 1 stands for the Stratonovich and u = for the Ito convention, respectively. Diffusion 
coefficient D{ within small noise approximation can be written as 



A = an + D' ll9 f(X ie ) + 2\ ii Ja ii D' ii g i (X ie ) 



(12) 



where e in X ie refers to the steady state value of X iy i. e., X ie is a solution of 



F i ({X l }) = i = l,...,N 



(13) 



The choice of specific forms of nonlinearity in Lj({Xj},i) results in typical features of 
nonequilibrium phase transitions in model systems. For the present purpose, however, we 
retain a general structure for the rest of the treatment. 



B. Information Entropy production 

Information entropy S is formally defined in terms of the phase space distribution func- 
tion P(X, t) through the well-known relation 

S = - J dXP(X, t) In P(X, t) . (14) 

The above definition allows us to have an evolution equation for entropy. To this end we 
observe from Eqs. (|TUD (or (7)) and (O) that 



d ^ d 2 P ' 

' InP . (15) 



l dXf 

Performing partial integration of the right hand side of the above Eq.(15) and then 
dropping boundary terms (since the probability density tends to zero as \X\ — > oo), one 
obtains the following form of information entropy balance: 



The first term in ([16]) has no definite sign while the second term is positive definite 
because of positive definiteness of Dj. Therefore the second one can be identified as the 



entropy production (So) |T2| 



1 (dP, s ' 



s ° = V D >Jp,\aT,l dx (17) 



in the steady state. The subscript s of P s refers to steady state. It is therefore evident from 
Eq.(|l7D that 

S f i ux = JdX P S (X) V x ■ F = V7~F 

5*0 — —Sfiux • (18) 



Note that since we consider the system to be dissipative V^.F is negative and therefore So 
turns out to be positive. 



C. Influence of external perturbation 

It is now interesting to examine the entropy production when the dissipative system is 
thrown away from the steady state due to an additional weak applied force. To this end we 
consider the drift F\ due to external force so that the total drift F has now two contributions: 

F(X) = F (X) + hF 1 (X) . (19) 

When h = 0, P = P s . The deviation of P from P s in presence of nonzero small h can be 
explicitly taken into account once we make use of the identity for the diffusion term [|12|] 

8 2 P d 
dXf ~ dX~ 

When P = P s the second term in ( ^0|) vanishes. In presence of additional forcing the 
Eq.fllUD becomes, 

g = -V,.^-OT,.F I P + p ( ^(p.^L) (21) 
where ifi is defined as 
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P 



d\nP s 

dXi 



+ 



d 

dX,, 



P, 



d P 

'dXiP, 



(20) 



dlnP 

^fo-EA^. (22) 

Here we have assumed for simplicity that Di is not affected by the additional forcing. The 
leading order influence is taken into account through the additional drift term in Eq.(^Tj). 

Under steady state condition (P = P s ) and h = 0, the second and the third terms in 
(21) vanish yielding 

Vx-^Ps = . (23) 

It is immediately apparent that ipP s refers to a current J where J = ifiP s . The steady 
state condition therefore reduces to an equilibrium condition (J = 0) if 

V> = . (24) 

(In the next section we shall consider two explicit examples to show that ip = 0). This 
suggests a formal relation between F and Di as 

(9 In P 

where P s may now be referred to as the equilibrium density function in phase space. Fo 
contains dissipation constant 7. Depending on the problem it also depends on the correlation 
time Tj of the colour noise or on the cross correlation between the noise processes. 

To consider the information entropy balance equation in presence of external forcing we 
first differentiate Eq.flU]) with respect to time and use Eq. (|21|) . Following Ref. [12| one can 
show that in the new steady state (in presence of h ^ 0), the entropy production (Sh) and 
the flux (AS fi ux ) like terms balance each other as follows: 

S h = -AS flux (26) 

with 

S h = Y.V tJ [dXp(^\n0 (27) 



»t7 

and 



AS flux = h 2 j dX5PVx.Fi + h 2 jdX (j2 6P ■ ( 28 ) 

where we have put hSP = P — P s . 

In the following section we shall work out the specific cases to provide explicit expressions 
for the entropy production and some related quantities due to external forcing for different 
kinds of open systems mentioned in the last section. 



III. APPLICATIONS 

A. Entropy production in a system driven by an external colour noise 

To illustrate the theory we now consider a damped harmonic oscillator driven by an 
external, Gaussian Ornstein-Uhlenbeck noise, r\\. The noise correlation of r\\ is given by 
Eq.(30). 

4i =Pi 

Pi = -wfai - 1 + m (29) 

(m(t)m(t')) = (so) 

where u> is the frequency of the oscillator. 

To make notation consistent with Eq.(5) we would like to let Xi, X 2 and X 3 correspond 
to qi, pi and rji respectively. 

The relevant equations of motion are therefore as follows 

X± — Fi — X 2 , 

X 2 = F 2 = -ulX 1 - 1 X 2 + Xz , 



^3 = ^3 = + ^C3 , (31) 

r r 



where ( 3 is a 5-correlated noise 



9 



(Mt)W))=25(t-1?) 



Therefore for the Langevin Eq. (31) the Fokker-Planck Eq.(7) becomes 
dP dP d Id D° d 2 P 

m = ^axl + axy^ + ^ - x ^ p + +7^< A '' P > + -axl (32) 

We now use the following transformation 

U = aX 1 + bX 2 + X 3 , (33) 

where a and b are constants to be determined. 

Then under steady state condition Eq.(32) reduces to the following form: 

*. mP . + D n = 0t (34) 

where 

D° 

D s = —, (35) 

T 

and 

YU = -aX 2 + bcu 2 X 1 + b^X 2 - bX 3 + — . (36) 

T 

Here Y is again a constant to be determined. Putting (33) in Eq. (36) and comparing 
the coefficients of X 1 , X 2 and X 3 we find 

Ya = —uj^b , Yb = —a + 67 . 

and 

Y = -b+- (37) 

T 

The physically allowed solutions for a, b and Y are as follows ; 

' 7 + --^ 2 -^o 2 )(-7-V-r 2 -^o 2 ) 



T 1 r 1 
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and 



r = -\ + \\li 2 -4*l (38) 

The stationary solution of (34) P s is then given by 

P s = N s e~^ . (39) 



Here iV s is the normalization constant. By virtue of (39) ip corresponding to Eq.(22) is 
therefore 

<9 In P 

^ = TU-D s ^ = 0. (40) 

Since vf)P s defines a current, P s defines a zero current situation or an equilibrium condi- 
tion. The equilibrium solution P s from (39) can now be used to calculate the steady state 
entropy production as given by Eq.(17). We thus have 

* = v -LtM)'" t - (41) 

Explicit evaluation shows 

S = T , (42) 

where T is given by Eq.(38). Thus at equilibrium the entropy production is inversely pro- 
portional to relaxation time of the process. 

We now introduce an additional weak forcing in the dynamics. This may achieved by 
adding a constant external force field f c in the dynamics. Eq. (31) then becomes 

Xi = X 2 

x 2 = -ulx Y - 1 x 2 + u + x 3 



X 3 = -±* + (43) 
r r 

Then the non-equilibrium situation (due to additional forcing, F i2 = f c ) corresponding 
to Eq.(43) is governed by 
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BP BP B B 1 B D° B 2 P 

Using the transformation (33) again in Eq.(44) we have 

-^-(TU)P s -^-F u P + D s ^4 = , (45) 
dU K ' dU BU 2 ' K J 

T and other constants are given by the Eq. (38). Here F u is 

F u = bf c (46) 
The now stationary solution of (45) in presence of external forcing is now given by 

, , T \tt2 2F u U l 

P' s = N'e-^ [u — — ] , (47) 



where N' is the normalization constant. 

We are now in a position to calculate the steady state entropy flux (AS f[ ux ) due to 
external forcing (h ^ 0) from Eq.(28) 



AS flux = J dXSPV.F, + jdX (^Fu^^j 5P , 



(48) 



putting h — 1. 

The components of F 1 in [/-space can be identified as 

F n = F u and V v ■ F l = (49) 

5P = P' s — P s denotes the deviation from the initial equilibrium state due to external 
forcing. For normalized probability functions P' s and P s the first integral in (48) vanishes. 
Thus the entropy production at steady state due to weak forcing is given by 



Sh — —AS fl ux 

D : 



^- I F.USPdU 



Making use of the definition of 5P and integrating explicitly we obtain 
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Putting D s from Eq.(35) and b from (38) we obtain 



4 - 4 7 r + 7V 2 + r 2 ( 7 2 - 4a; 2 ) - 2r^ 2 - 4wg(2 - 7 r) 



4D° 



(51) 



We now examine specifically the following two limits: 

(i) In the Markovian limit r — * the above expression reduces to the following form: 

Sh = % (52) 

For the closed thermodynamic system D° = ~fkT which reduces the above expression 
to the standard result for entropy production of irreversible thermodynamics for Brownian 
oscillator. 

(ii) Next we consider an interesting limiting case uj — * 0, which implies that for a free 
Brownian particle we have 

1 — 7T 

a = , b = — and T = 7 

T 

c (1 -irf.fi ,,,, 

The above expression depicts an interplay of the dissipation constant 7 of the system 
and the correlation time r of the noise in determining the entropy production. Two different 
cases are noteworthy; 

(a) 7T < 1 or r < ±: 

When relaxation time of the system greater than correlation time of external noise the 
entropy production S h decreases with increase of r until r > -. 

(b) 7 r > 1 or r > ±: 

The entropy production Sh increases with increase of r until r > K It is interesting to 
note that in the limit 7 r = 1 entropy production is zero. A plot of entropy production in 
the steady state vs correlation time therefore exhibits a minimum (See Fig. 1). It is thus 
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apparent that in presence in presence of the nonequilibrium constraint the properties of 
noise processes as well as the dynamic characteristic of the system are important for entropy 
production. 



B. Entropy production in a cross-correlated noise driven system 

We now turn to the second case where a simple dissipative system is driven by both 
additive and multiplicative noises. 

X, = -7*! - Ci^i + r/i (54) 

Here L\ in Eq.(8) corresponds to —7X1. The correlation between the noise processes are 
given by 

(Ci(f)Ci(0> = 2J^*(t-0 

M^MO) = 2a u 5(t-1?) 

(Ci(t)vi(t')) = (Ci(t')m(t)} = 2X ll ^D[ 1 a 11 d(t-t') ,0 < A n < 1 (55) 

An denotes the cross-correlation between the two noise processes. 
Eq.(10) for this system reduces to 

ggj _ d(F lP ) d*P 

-^^-~^xt + i m (56) 

where the drift term is 



F 1 = -(7 + 2D' U - u)X 1 + (2 - v)\ 11 JD' ll a 11 (57) 



and 



where, 



D 1 = D' u Xf e - 2An JD' uail X le + an (58) 



-f + 2D' n -u v ; 
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Making use of steady state value of Xi, i. e. X le in Eq.(58) we obtain the following 
constant diffusion coefficient in the weak noise limit 

Di = [»u7 2 + (2 - v)D' liail {(2 - u)D' u + 2 7 - 27^1 - X 2 U (2 - u)D' u }] (go) 

where 

T' = 7 + 2D' n - v (61) 

Now the stationary solution of Eq.(56) is given by 

P s = N ie ~^ [ 1 ~ 1 , (62) 

where Ni is the normalization constant. 
/ is given by 



1= (2-z/)A 11V / ^n«n (63) 
Putting (62) in Eq.(22) one may show as before that 

i) = (64) 
Thus P s is an equilibrium probability distribution function. 

Using Eq.(62) in Eq.(17) we obtain the standard expression for entropy production at 
equilibrium 

£ = r (65) 

As before V is a negative divergence of the drift term in Eq.(61). Eq.(65) carries same 
message as in Eq. (42) but for a different system. It is apparent that the cross correlated 
diffusion coefficient D' u between the noise processes is as important as the dissipation factor 
7 that determines the steady state entropy production. 

To study the effect of additional weak forcing on the stationary system we again add a 
constant field of force f e in the Eq.(54). Due to the additional forcing (Fu = f e ) in Eq. (54) 
we have 
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X 1 = 1 X 1 -( 1 +r ]l + f e (66) 

Then the non-equilibrium situation corresponding to Eq.(66) is given by 

dP _ dT'X l F ,dP d 2 P 

where, 

K = fe + l (68) 

Using the stationary solution of Eq.(67) in Eq.(28) as in the previous section we obtain 
the expression for entropy production in the steady state 

o = [ 7 2 + (2-^Df 1 + 2 7 (2-^)^ 1 ]/ e 2 

* [a nl * + (2-v)D[ 1 a u {(2-v)D 1 + 2 1 -2 1 \j 1 -\l 1 (2-v)D> 11 }\ { ] 

One may recover the standard results for a closed system by switching off the multi- 
plicative noise (D' n = 0) and implementing fluctuation-dissipation relation a n = jkT in 
Eq.(69). We then obtain 

f 2 f 2 

S h = ^- = (70) 

Eq. (69) implies that for finite D' u entropy production is an increasing function of the 
cross correlation (i.e An) between the two noise processes. 



IV. CONCLUSIONS 

In this paper we have examined the role of noise properties of stochastic processes in 
entropy production under a steady state condition. As specific cases we have considered 
Ornstein-Uhlenbeck noise with finite correlation time and cross-correlated noises driving the 
dynamical system. Based on an information entropy balance equation we have shown that 
the entropy production and flux like terms not only depend on the dissipative characteristics 
of the dynamics of the phase space of the dynamical system, particularly, the rate of phase 
space volume contraction, but also on the correlation time and strength of cross correlation 
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of the noises. Since the steady state entropy production is identified as a drift term in the 
Fokker-Planck description in the present formalism and the correlation time or the strength 
of cross-correlated noises make their presence felt in this term, it is not difficult to trace the 
origin of the role of interplay of dissipation and the properties of the noise processes. In 
view of the fact that the Ornstein-Uhlenbeck noise processes or the cross-correlated noise 
processes are commonly occurring situations in condensed matter physics and chemistry, we 
hope that the present analysis will be useful in irreversible thermodynamics in relation to 
dynamical systems, in general. 
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FIGURES 

FIG. 1. Plot of entropy production Sh vs correlation time r for the Eq.(53) using 7 = 1.0, 
f c = 1.0 and D° = 1 (Units are arbitrary). 
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